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DETAILED ACTION 

Background 

1 . This Action is responsive to communications: filed on 6/17/2009. 

2. Claims 1, 2, 4-5, 7, 9, 1 1-15, 17-19, 21, and 22 are pending. 

Response To Amendment 

3. Arguments concerning the Examiner's Rejections of claims 1, 2, 4-15, 17-19, 21 
and 22 under 35 U.S.C. § 102(b) in the previous Office Action have been fully considered but are 
not persuasive. The rejections have been maintained in view of Robothamv et al. (PG-Pub. 
2002/0015042 Al), addressed below. 

Claim Rejections-35 U.S.C. §102 

4. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a 
foreign country or in public use or on sale in this country, more than one year 
prior to the date of application for patent in the United States. 

5. Claims 1, 2, 4-7, 9, 11-15, 17-19,21 and 22 are rejected under 35 U.S.C. 102(b) 
as being anticipated by Robothamv et al. (PG-Pub. 2002/0015042 Al). 

I. Citation of Prior Art 
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A reference to specific paragraphs, columns, pages, or figures in a cited prior art 
reference is not limited to preferred embodiments or any specific examples 1 . It is well settled 
that a prior art reference, in its entirety, must be considered for all that it expressly teaches and 
fairly suggests to one having ordinary skill in the art 2 . Stated differently, a prior art disclosure 
reading on a limitation of Applicant's claim cannot be ignored on the ground that other 
embodiments disclosed were instead cited. Therefore, the Examiner's citation to a specific 
portion of a single prior art reference is not intended to exclusively dictate, but rather, to 
demonstrate an exemplary instance where the disclosure is commensurate with the specific 
limitation(s) being addressed. 

II. General Discussion of the Applied Prior Art. 

Robothamv et al. relates to display of visual content on a client device using server-side 
rasterization of visual content. Visual content is rendered on a server system, transformed into 
bitmaps compatible with the display attributes of a client device, and transmitted for display on 
the client device. The invention allows the server to perform, in effect, as a remote browser for 
displaying Web pages, e-mail, e-mail attachments, electronic document and forms, database 
queries and results, drawings, presentations, and images at the client device. The approach is 
"remote" because the server does the rendering and the client provides the interface; "multi- 
level" because rendered visual content is represented as a multi-level set of raster 

1 In re Heck, 699 F.2d 1331, 1332-33, 216USPQ 1038, 1039 (Fed. Cir. 1983) (quoting In re Lemelson, 397 F.2d 
1006, 1009, 158 USPQ 275, 277 (CCPA 1968). 

2 Upsher-Smith Labs. v. Pamlab, LLC, 412 F.3d 1319, 1323, 75 USPQ2d 1213, 1215 (Fed. Cir. 2005); In reFritch, 
972 F.2d 1260, 1264, 23 USPQ2d 1780, 1782 (Fed. Cir. 1992); Merck & Co. v. Biocraft Labs., Inc., 874 F.2d 804, 
807, 10 USPQ2d 1843, 1846 (Fed. Cir. 1989); In re Fracalossi, 681 F.2d 792, 794 n.l, 215 USPQ 569, 570 n.l 
(CCPA 1982); In re Lamberti, 545 F.2d 747, 750, 192 USPQ 278, 280 (CCPA 1976); In re Bozek, 416 F.2d 1385, 
1390, 163 USPQ 545, 549 (CCPA 1969). 
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representations; and constitutes a "browsing system" because the client and server share data 
about the source visual content element being browsed, and the client performs a specific 
browsing function assisted by the server. 

III. Prior Art Anticipation of Claimed Limitations. 

As to independent claim 1, Robothamv et al. describe(s): a computer program 
product ("...computer program...," para. [0058]), tangibly embodied in a computer- 
readable storage medium ("...mass storage device ...," para. [0059]), comprising 
instructions operable on a client computer to: provide on a client computer a user 
interface for a computer program application ("...client device...." para. [0002]), the user 
interface being operable to receive input from a user interacting with the client and 
from the input to generate user interaction events ("...event processing functions...," 
para. [0108]); identify on the client one or more future user interaction events they may occur 
while the user interface is in a current user interface state ("...at different states of play or a 
transaction at different stages of processing...," para. [0106]), estimate a likelihood for the future 
user interaction events to generate one or more future user interface states ("...a context and state 
for coordinating different functions of the browser...," para. [0075]); store the one or more future 
user interface states for later use ("...later time para. [0235]); corresponding to the generated 
future user interface states while the user interface is in the current user interface state ("...Each 
remote browsing session has associated browsing session data 40 that maintains the context and 
state of the remote browsing session...," para. [0131]); and store the one or more future user 
interface appearances for later use ("...In a further embodiment, additional events received during 
client event processing are queued for later processing....," para. [0269]) determine an estimated 
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likelihood for the future user interaction events to occur based on a history of previous user 
inputs to the user interface and select one or more of the future user interaction events to pre- 
process based on the estimated likelihoods for the future user interaction events: 

[0297] If switches between representation levels are handled on the client device 
24, the client 24 can echo a selection event to the server 22, since it contains 
useful information about current client 24 activity. 

*** 

[0299] Client-side Caching of Derived Representations 

[0300] When the client 24 is caching derived representations, interface 9 
determines which caches are valid and when it is appropriate to request refreshed 
versions from the server 22. A cache validation scheme can be based on the "age" 
of a cached representation. The age is defined as the difference between the 
current time and the time when the cached representation was received from the 
server 22. In one embodiment, the client 24 requests a refresh when the age 
exceeds a certain threshold. The aging threshold can be set by the server 22 and 
sent to the client or, alternatively, be set by the client 24 or the client user. 

As to dependent claim 2, which depends from claim 1, Robothamv et al. further disclose: 
the product of claim 1, further comprising instructions to: receive an actual input from the user 
and, if one of the future user interface states corresponds to the actual input, render the future 
user interface appearance corresponding to the first user interface state ("...comparing time- 
stamps between the current visual content element 10 and the cached representation;...," para. 
[0321];". ..accessing refresh data associated with the current visual content element 10....," para. 
[0321]). 

As to dependent claim 4, which depends from claim 1 , Robothamv et al. further disclose: 
the product of claim 1 , wherein the instructions to generate code to render the first user interface 



states: 
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[0010] For example, an HTML document can be rendered by an HTML 
rendering function in one rasterizing mode. This HTML source can also be 
transcoded to a WML (Wireless Markup Language) format and then 
rasterized by a WML rendering function in a second rasterizing mode. The 
two different representations can be associated as a multi-modal set, based 
on their relationship to the original HTML-encoded visual content 
element. 

[001 1] Transcoding can also be used to generate a different version of the 
source visual content element using the same encoding format as the 
original. For example, an HTML document can be transcoded into another 
HTML document, while changing, translating or removing certain 
encoded data. For example, references to unwanted or objectionable 
content can be removed, automatic language translation can be applied to 
text components, or layout directives can be removed or changed to other 
layout directives. 



As to dependent claim 5, which depends from claim 4, Robothamv et al. further disclose: 
the product of claim 4 wherein the code to render the first user interface state comprises HTML 
(Hypertext Markup Language) code ("...The format of the text-related content can be represented 
in a specialized format, a subset of a standard format, such as HTML...," para. [0529]). 

As to dependent claim 7, which depends from claim 1, Robothamv et al. further disclose: 
the product of claim 1, further comprising instructions to: specify an order for pre-processing 
future user interaction events based on the estimated likelihoods that the future user interaction 
events will occur. 

"...In one embodiment, the data transmission is sequenced in a manner 
allowing an overview representation to arrive first, thereby providing the 
client 24 device with an opportunity to display the overview representation 
while other representations are transmitted....," 



(para. [0189]). 
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As to dependent claim 9, which depends from claim 1, Robothamv et al. further disclose: 
the product of claim 8, wherein: the user interface comprises a control having instructions to 
establish the estimated likelihood for the future user interaction events f ("...generating multiple 
client display surfaces (stored in main memory and/or in mass storage) that collectively represent 
the single virtual client display surface 26...," para. [0146]); ("...implementation of prioritized 
viewing for selection para. [0208]). 

As to dependent claim 11, which depends from claim 1, Robothamv et al. further 
disclose: the product of claim 1, wherein: the instructions to pre-process the selected future user 
interaction events to generate one or more future user interface states comprise instructions to 
obtain data from the application for future user interface states ("...obtains information specifying 
the dimensions and display characteristics of the client viewport, and explicitly represents the 
client viewport 16...," para. [0126]). 

As to dependent claim 12, which depends from claim 1, Robothamv et al. further 
disclose: the product of claim 1, wherein the instructions to each of the selected future user 
interaction events has estimated likelihoods of occurrence exceeding a threshold probability and 
the future user interaction events other than the selected future user interaction events have 
estimated likelihoods that do not exceed the threshold probability ("...The aging threshold can be 
set by the server 22 and sent to the client or, alternatively, be set by the client 24 or the client 
user....," para. [0300]). 

As to dependent claim 13, which depends from claim 1, Robothamv et al. further 
disclose: the product of claim 1, wherein: the computer program product is a program running on 
a server computer in data communication with the client computer ("...The user experience 



Application/Control Number: 10/676,846 Page 8 

Art Unit: 2179 

differs from the user experience in which the client 22 propagates the same location events to the 
server 22....," para. [0287]); and the instructions to provide a user interface on the client 
computer comprise instructions to provide the user interface in a Web browser ("...In some 
embodiments, server-side rendering is accomplished using a web browser...," para. [0157]). 

As to independent claim 14, Robothamv et al. describe(s):, the user interface being 

operable to receive input from a user interacting with the client and from the input to generate 

user interaction events ("...event processing functions...," para. [0108]); 

[0297] If switches between representation levels are handled on the client 
device 24, the client 24 can echo a selection event to the server 22, since it 
contains useful information about current client 24 activity. 



[0299] Client-side Caching of Derived Representations 

[0300] When the client 24 is caching derived representations, interface 9 
determines which caches are valid and when it is appropriate to request 
refreshed versions from the server 22. A cache validation scheme can be 
based on the "age" of a cached representation. The age is defined as the 
difference between the current time and the time when the cached 
representation was received from the server 22. In one embodiment, the 
client 24 requests a refresh when the age exceeds a certain threshold. The 
aging threshold can be set by the server 22 and sent to the client or, 
alternatively, be set by the client 24 or the client user. 

iidentifying on the client one or more future user interaction events while the user interface is in 
a current user interface state ("...at different states of play or a transaction at different stages of 
processing...," para. [0106]), the future user interaction events being user interaction events that 
would arise from an input the user interface could possibly receive from the user, in the current 
user interface state, from the user ; 
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determininq an estimated likelihood for the future user interaction events to occur based on a 
history of previous user inputs to the user interface; selectinq one or more of the future user 
interaction events to pre-process based on the estimated likelihoods for the future user interaction 
events; 

pre-processing one or more of the future user interaction events to generate one or more future 
user interface states ("...Each remote browsing session has associated browsing session data 40 
that maintains the context and state of the remote browsing session...," para. [0131]); storing the 
one or more future user interface states for later use, pre-renderinq one or more of the future user 
interface states togenerate one or more future user interface appearances while the user interface 
is in the current user interface state ; and storing the one or more future user interface 
appearances for later use ("...In a further embodiment, additional events received during client 
event processing are queued for later processing....," para. [0269]). 

As to dependent claim 15, which depends from claim 14, Robothamv et al. further 
disclose: the method of claim 14, further comprising: receiving an actual input from the user and, 
if one of the future user interface states corresponds to a user interaction event that arises from 
the actual input from the user, make the corresponding one of the future user interface states the 
current user interface state ("...the server sends the corresponding partial raster representation to 
client for browsing...," para. [0027]). 

As to dependent claim 17, which depends from claim 14, Robothamv et al. further 
disclose: the method of claim 14, further comprising: specifying an order for pre-processing the 
future user interaction events ("...pre -rendering step...," para. [0018]). 
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As to independent claim 18, Robothamv et al. describe(s): An apparatus, comprising: a 
means formplementing a user interface for a computer program application ("...executable 
computer program instructions...," para. [0060]), the user interface being operable to receive 
input from a user interacting with the client and from the input to generate user interaction events 
("...event processing functions...," para. [0108]), means for identifying one or more future user 
interaction events while the user interface is in a current user interface state ("...at different states 
of play or a transaction at different stages of processing...," para. [0106]), the future user 
interaction events being user interaction events that would arise from an input the user interface 
could possibly receive ("...If a relevant proxy display surface 28 has already been generated for 
the entire visual content element, then only the transform and possibly transmission functions 
need to be performed....," para. [0505]), in the current user interface state ("...context and state 
...," para. [0075]), means for determining an estimated likelihood for the future user interaction 
events to occur based on a history of previous user inputs to the user interface; means for 
selecting one or more of the future user interaction events to pre- process based on the estimated 
likelihoods for the future user interaction events: 

[0297] If switches between representation levels are handled on the client device 
24, the client 24 can echo a selection event to the server 22, since it contains 
useful information about current client 24 activity. 



[0299] Client-side Caching of Derived Representations 

[0300] When the client 24 is caching derived representations, interface 9 
determines which caches are valid and when it is appropriate to request refreshed 
versions from the server 22. A cache validation scheme can be based on the "age" 
of a cached representation. The age is defined as the difference between the 
current time and the time when the cached representation was received from the 
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server 22. In one embodiment, the client 24 requests a refresh when the age 
exceeds a certain threshold. The aging threshold can be set by the server 22 and 
sent to the client or, alternatively, be set by the client 24 or the client user. 

means for pre-processing one or more of the future user interaction events to generate one 
or more future user interface state; and means for storing the one or more future user interface 
states for later use ("In one embodiment, the client 24 requests a refresh when the age exceeds a 
certain threshold.," para. [0300]); means for pre-rendering one or more of the future user 
interface states to generate one or more future user interface appearances while the user interface 
is in the current user interface state ("...The likelihood of a stale cache is increased in the third 
approach. In one embodiment, the client 24 requests that the server 22 determine if a refresh is 
recommended, and if so indicates to the user that a "stale" cached version is being displayed until 
the refresh arrives....," para. [0285]); and means for storing the one or more future user interface 
appearances for later use ("...In a further embodiment, additional events received during client 
event processing are queued for later processing....," para. [0269]) a processor for implementing 
at least the means for pre-processing. 

As to dependent claim 19, which depends from claim 18, Robothamv et al. further 
disclose: the apparatus of claim 18, further comprising: means for receiving an actual input from 
the user and, if one of the future user interface states corresponds to a user interaction event that 
arises from the actual input from the user, making the corresponding one of the future user 
interface states the current user interface state ("...accessing refresh data associated with the 
current visual content element 10....," para. [0321]). 
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As to dependent claim 21, which depends from claim 18, Robothamv et al. further 
disclose: the apparatus of claim 18, further comprising: means for specifying an order for pre- 
processing the future user interaction events: 

"...In one embodiment, the data transmission is sequenced in a manner 
allowing an overview representation to arrive first, thereby providing the 
client 24 device with an opportunity to display the overview representation 
while other representations are transmitted....," 

(para. [0189]). 

As to dependent claim 22, which depends from claim 12, Robothamv et al. further 
disclose: the product of claim 12, further comprising instructions for raising or lowering the 
threshold ("Similar mechanisms allow the client 24 user to select a lower level representation 
from a higher level representation. Selection events include user interface actions such as mouse 
"clicks," pen clicks, or button presses.," para. [0201]). 

Response To Arguments 

6. Applicant arguments, with respect to the 35 U.S.C. §102 Rejections cited by the 
Examiner in the previous Office Action have been fully considered but are maintained in view of 
Robothamv et al. 

Applicant argues (at p. 12): 
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Claim 1 further recites "estimat[in.q] a likelihood for the future user 
interaction events to occur based on a history of previous user inputs to the 
user interface." (emphasis added). As discussed, Robotham stores content 
representations in a cache, and employs an "aging threshold" to determine 
which content representations should be stored in the cache (Robotham, ]f 
300). However, Robotham does not disclose estimating a likelihood that 
future interaction events will occur. Rather, Robotham merely discloses 
replacing cached content representations that have been stored in the cache 
for an amount of time that exceeds the aging threshold (Robotham, ]f 300). 
Therefore, Robotham also fails to teach or suggest "estimatrin,q] a 
likelihood for the future user interaction events to occur based on a history 
of previous user inputs to the user interface," as recited by independent 
claim 1 (emphasis added). 

The Examiner points out that Robotham's "likelihood" is in fact determined based on a history of 

previous user inputs to a user interface: 

A representative embodiment illustrates the advantages of adaptive client/server 
rendering. The user views a server-side rendering of an e-mail message which 
contains attachments rendered as hypertext links. The user clicks on a hypertext 
link to view the associated document. In current client-side rendering systems, 
this initiates a download of the associated document and cither a "file save" or a 
client-side rendering of the document. 



See also elm. 19: 

19. The method of claim 18 further comprising the steps of: producing a user 
interface action at the user interface; and generating a response in response to the 
user interface action and the data element. 
Also taught in para. 300: The cache validation scheme can be based on the "age" of a 

cached representation. The age is defined as the difference between the current time and the time 

when the cached representation was received from the server 22. 

Conclusion 

7. All prior art made of record in this Office Action or as cited on form PTO-892 
notwithstanding being relied upon, is considered pertinent to applicant's disclosure. 
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[1] Barrett et al. (US Patent No. 5,727,129) for teaching a system that tracks a user's 
past history of websites visited, including the frequency and dates and times of 
visits, in order to predict what web information is likely to be accessed by the user 
in the future. 

[2] Smith et al. (US Patent No. 6,742,033 Bl) for teaching a that network 
delivered/based content can be sped up to pre-cache internet content where pre- 
caching internet content may mean downloading information from the internet 
that the system predicts that the user will request in the future. 

[3] Aaker et al. (US Patent No. 5,758,087 A) for teaching a computer, e.g. a server or 
computer operated by a network provider sends one or more requesting computers 
(clients) a most likely predicted-to-be selected (predicted) page of information by 
determining a preference factor for this page based on one or more pages that are 
requested by the client. 

[4] Mogul (US Patent No. 5,802,292 A) for teaching a method for predictive pre- 
fetching of objects over a computer network. 

[5] O'Brien et al. (US Patent No. 6,055,569 A) for teaching a browser working in 
conjunction with a HTTP server that selectively downloads WWW pages into the 
browser's memory cache by evaluating the weight to a predetermined browser 
criteria so only those pages most probably to be downloaded are stored in the 
browser's memory cache. 

[6] Horvitz (US Patent No. 6,067,565 A) for teaching a technique for pre-fetching a 
web page of potential future interest in lieu of continuing a current information 
download. 

[7] Horvitz (US Patent No. 6,085,226 A) for teaching a method and apparatus for 
utility-directed prefetching of web pages into local cache using continual 
computation and user models. 

[8] Altschuler et al. (US Patent No. 6,154,767 A) for teaching building a resource 
(such as Internet content for example) and attribute transition probability models 
and using such models to predict future resource and attribute transitions. 



Therefore, Applicant is required under 37 CFR §1.1 11(c) to consider these references 
fully when responding to this Office Action. 
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8 . THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of 
time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

9. Any inquiry concerning this communication or earlier communications from the 
Examiner should be directed to Samir Termanini at telephone number is (571) 270-1047. The 
Examiner can normally be reached from 9 A.M. to 6 P.M., Monday through Friday. 

If attempts to reach the Examiner by telephone are unsuccessful, the Examiner's 
supervisor, Weilun Lo can be reached on (571) 272-4847. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
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like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Samir Termanini/ 
Examiner, Art Unit 2179 



/Ba Huynh/ 

Primary Examiner, Art Unit 2179 



